Communication and Synchronization in Disconnected Networks with Dynamic 
Topology: Moving Neighborhood Networks 
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We consider systems that are weU modeUed as a networks that evolve in time, which we call Moving 
Neighborhood Networks. These models are relevant in studying cooperative behavior of swarms and 
other phenomena where emergent interactions arise from ad hoc networks. In a natural way, the 
time-averaged degree distribution gives rise to a scale-free network. Simulations show that although 
the network may have many noncommunicating components, the time-averaged communication is 
sufficient to yield robust synchronization of chaotic oscillators. 

PACS numbers: 05. 45. -a 
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Network dynamics has become a very important area 
in nonlinear studies because so many systems of interest 
have a natural description as a network. Examples include 
the internet, power grids, neural networks (both biological 
and other), social interactions, and many more. However, 
the preponderance of the work in complex networks does 
not allow for dynamic network topology (Ij, i^]. To our 
knowledge, there has not been published any significant 
work on time-dependent network architecture, and none 
which considers a natural model of meandering agents. 
In the literature, one finds that either a static network is 
'born', as in the small-world (SW) |^ and Erdos-Renyi 
models, or that a network evolves into an otherwise static 
configuration, as is assumed in the Barabasi- Albert model 
of scale-free (SF) networks evolution 0. In epidemic mod- 
eling and percolation theory, one considers the problem of 
certain links being knocked-out, but essentially as a static 
problem, since there is no possibility for links to reform 
within the theory. 

In this letter we consider a simple model that allows net- 
work links to follow their own dynamical evolution rules, 
which we consider a natural feature of many natural and 
technological networks, where autonomous agents mean- 
der or diffuse, and communication between them is an 
issue of both geography and persistence. For our concept 
problem, we focus on social interactions, such as a disease 
propagating across a network of social contacts. A suit- 
able model should consider disease life-cycle, which may 
be just a matter of a few weeks; an epidemic ensues only if 
agents connect within that time window. Thus, with ex- 
piring messages, what matters is whom we have recently 
contacted. No current network models appropriately ac- 
count for this realistic feature. When the time scale for 
network changes is of the nearly the same order as the time 
scales of the underlying system dynamics, we believe that 
network evolution should be part of the model. We will 
study such networks using a model which we first intro- 
duce here and which we call moving neighborhood networks 
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(MN). We then modify the basic MN structure by consid- 
ering that some social connections survive even when the 
local neighborhood has changed, which we call the moving 
neighborhood with friends model (MNF). 

We evolve (diffuse) positions of agents independently 
according to a dynamical system, or stochastic process, 
linking those nodes that are within the same neighbor- 
hood. We assume that the system has an ergodic invari- 
ant measure, then we prove that the relative positions of 
the nodes, and hence their connectivity, is essentially ran- 
dom, but with a well defined time average degree distri- 
bution. Using the property of synchronization as a probe 
of connectivity, we show a most striking feature of such 
networks is that while at any fixed time, the network may 
be fractured into noncommunicating subcomponents, the 
evolving network allows communication of those messages 
which do not expire on time-scales at which a message 
can find paths between subcomponents; this point is made 
clear by the fact that MN and MNF networks admit sur- 
prisingly robust synchronization well below the threshold 
when the network has a giant component. 

We consider two distinct dynamical systems: 1) the dy- 
namical system which governs the network topology by 
diffusing agents corresponding as the indexed vertices, 
which we call network dynamics, and 2) the network of 
the oscillators which run at each vertex, with coupling 
between them moderated by the instantaneous network 
configuration, which we call the system dynamics. The 
formalism of master stability function ^lOj (which assumes 
a fixed network) must be modified to consider evolving 
networks. Synchronization requires sufficient information 
flow, so complete paths must appear on time scales rele- 
vant to the system dynamics. We introduce the concept of 
a moving average Laplacian to quantify the connectivity 
associated with a time sensitive message that propagates 
on a partially connected but changing network. 

The Moving Neighborhood Network: Our model- 
ing goal is to capture some features of evolving social net- 
works. Using an analogy of collaborators: often we work 
as part of a group at our place of employment, usually 
dealing with a small group of people (our neighborhood) . 
People move from one job to another, so our neighborhood 
will frequently change, but only a little. However, if we 
move, our neighborhood changes significantly; we end up 
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with a completely different group of coworkers. The time 
scale of the small changes is of the same order as might be 
required to tackle significant problems and therefore are 
relevant to the overall productivity of the group. 

To capture this dynamic, we associate network nodes 
with an ensemble of points evolving under a flow, form- 
ing a time dependent network by linking nodes that are 
'close.' Notationally, let f = {^i, . . . ,^„} be a collection 
of n points in some metric space M. . We construct graph 
S from ^ by associating a vertex with each element of ^. 
Vertices i and j of S are assigned to be adjacent (con- 
nected by an edge) if ~ Cjl < ''i where r is a parameter 
that defines the size of a neighborhood. Let 0t : 
be the flow of some dynamical system on M. From an 
initial ensemble f° = {C?, ■ • ■ , we define an ensemble 
trajectory by 



C» = <i>.(e°) = W*(^?),...>t(e°)}, 



(1) 



which in turn generates a graph that precribes a net- 
work trajectory. The flow (j)t may be governed by any 
discrete or continuous time diffusive process, either de- 
terministic or stochastic. For brevity of presentation, we 
describe the MN process by using a deterministic, ergodic 
map (7), representative of strobing a continuous diffusive 
system. Under suitable choice of 7, most ensembles will 
distribute according to some natural invariant density, p^, 
giving a well defined time-average network character. 

Simulation: a specific MN network. Consider the 
following construction: Let A/ = T^, the circle, and let 



7(0;) :— 1.43a; 



.43-^ mod 1. 



(2) 



This map, chosen primarily for illustrative reasons, has the 
following characteristics: (1) it is choatic, (2) transitive on 
the invariant set [0, 1], (3) uniformly expanding, (5) with 
non-uniform invariant density, and (5) is discontinuous (so 
that a node may be moved to a distant neighborhood on 
one iteration). From a random initial condition for S^, we 
iterate past the transient phase so that the ensemble re- 
sembles the invariant density. We then construct the asso- 
ciated network for each iteration of map 7. Fig^shows the 
network constructed from five successive iterations, using 
n — 2% and r — 0.09. Note that from one iteration to the 
next, the connections associated with node 1 change very 
little. The reindexing and redrawing in the second row 
makes clear that the network is a neighborhood graph, 
though not all neighborhoods contain the same number 
of nodes. Note that all but the t -I- 2, the graphs have a 
disconnected component. 

Synchronization of Coupled Oscillators: To ex- 
plore the implications of an MN structure, we use syn- 
chronicity as a connectivity persistence probe of a net- 
work of n identical chaotic oscillators. We form a time 
dependant network, described by graph G{t), consisting 
of n vertices {fi}, together with the set of ordered pairs of 
vertices {{vi^Vj)} which defines the edges. The nx n ad- 
jacency matrix defines the edges, Aij{t) = 1 if there is an 
edge (vi,Vj) at time t, and = otherwise. The system of 
n oscillators is linearly coupled by the network as follows: 
Let the vector x, be the state vector for the zth oscillator 



node 
order 




node 
position 



FIG. 1: (Color online) An MN simulation using n — 28, 
r — .09, and map of Q. Five time steps are shown. The 
1st row shows the network in node index order. The 2nd row 
is the same network, with the nodes positioned by ordered to 
illustrate that they are neighborhood graphs. The (bold) red 
portion of the network shows connections to node 1. The bot- 
tom row shows the ensemble distribution of ^. The relatively 
small n — 28 was chosen for artistic reasons (to more easily 
display the connections). 



and express the coupled system as 



x,{t) = /(x,(i)) +a^L„(t)i^x,(t), 



(3) 
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where a a control parameter, Lij{t) the element of the 
graph Laplacian, L{t) = Diag{d) — A{t), and K speci- 
fies which state vector components are actually coupled. 
Thus we have a dynamical system fiowing on 3?'^" . Specifi- 
cally, we consider the Rossler attractor with a — 0.165, h — 
0.2, c = 10.0, which exhibits a chaotic attractor with one 
positive Lyapunov exponent Coupling the n systems 
through the Xi variables, the resultant system is given by 



— Vi ^\ 

yi = Xi+ ay^ 
Zi + Zi{xi - c). 



(4) 



Then the question of whether the oscillators will synchro- 
nized is reduced to whether one can find a value for a such 
that the synchronization manifold is stable. 

Known results for static networks. For a fixed net- 
work, necessary conditions for synchronization are well de- 
scribed by the approach in 0,113 j summarized as follows: 
The graph Laplacian matrix L has n eigenvalues, which 
we order as = 6'o < . . . < dn-i — &max- Using finear 
perturbation analysis, the stability question reduces to a 
constraint upon the eigenvalues of Laplacian: 



a9i e (ai, q;2) Vi = 1, 



1, 



(5) 



where ai,a2 are given by the master stability function, 
a property of the oscillator equations. For a small, syn- 
chronization is unstable if a9i < ai; as tr is increased, 
instability arises when a0max > ct2- By algebraic manip- 
ulation of 0, one can show that if < then 
there is some coupling parameter, as, that will stabilize 
the synchronized state. For some networks, no value of 
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a satisfies (jSJ. In particular, since the multiplicity of tlie 
zero eigenvalue defines the number of completely reducible 
subcomponents, if d\ = 0, the network is not connected, 
and synchronization is not stable. However, even when 
6*1 > 0, if the spread of eigenvalues is too great, then syn- 
chronization may still not be achievable. 

Refinement to evolving networks. Numerical sim- 
ulations of the MN model indicate that synchronization 
can occur even when the network fails criteria of |(SJ) at 
every instant in time. Apparently, the temporal mixing 
creates an average connectedness that allows the network 
to support synchronization. 

We conjecture that an appropriate quantification of the 
average connectiviy is given by the Moving Average 
Laplacian, which we introduce here and define as the 
solution to the matrix initial value problem, 

C{t)^L{t)~C{t), C(0)=L(0). (6) 

We solve © to write 

C{t) = e-* (^CiO) + e^L{T)dT^ . (7) 

We estimate A* = E[Xi{C{t))] and X*^^^ = 
E[Xmax{C(t))], and then use XI and X^^^ with © to 
determine an appropriate choice for a to achieve stable 
synchronization on a particular MN network, which we 
now find predicts well the synchronization according to 
the now modified master stability formalism. 

Numerical explorations of MN behavior: Con- 
sider a system of rt = 100 agents wandering on the chaotic 
attractor of the Duffing equation, x" = x — — .02x' + 
Ssini, whose driven frequency is commensurate with the 
natural frequency of the Rossler system, a; ~ 1. If we 
choose r = .05, the network is disjoint - generally it has 
more than 25 disconnected components. With the Rossler 
systems starting from a random initial condition. Fig |21 
shows a plot of Xi{t), for the coupled system, which indi- 
cates that despite the weak instantaneous connectivity of 
the network, the average effect results in synchronization. 
The bold curve illustrates the asymptotic stability of the 
synchronization state by graphing 

1 " 

= - E i^'W - ^{t)\ + Mt) - y{t)\ + - mi 

1=1 

where {x{t),y{t), z{t)) = ^ Er=i(^i W> W> W) esti- 
mates the synchronization manifold. As an additional 
statistic, we define k^q, to be 1/2 the number of connec- 
tions per node, averaged over space and time, which allows 
direct comparison with the value fc of a regular graph. We 
calculate keq ~ 1.1 (in comparison to a regular network, 
which would require > 7 to synchronize); on average, a 
node is coupled to only a few other nodes on each time 
step. However, the rapidly changing laplacian compen- 
sates. Results are similar for other ergodic systems used 
to control agent fiow, such as 7(0;) in Eq. jSJ. 

Analysis and conjectures: A counterintuitive result 
from the simulations is that although the synchronized 
state may be linearly unstable, the MN network can still 
synchronize. The instantaneous interpretation is that an 
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FIG. 2: (Color online) MN Network with n = 100 nodes, 
r — .05, with agents wander according to the chaotic Duffing 
equation, x" — x — x'^ — .02a;' -1-3 sin t. The a;-coordinate of each 
oscillator is plotted vs. time. The bold line is A, providing an 
estimated deviation from the synchronization manifold. 

ensemble of conditions near the manifold is expanding in 
at least one direction, but is generally contracting in many 
other directions. When the network reconfigures, the ex- 
panding and contracting directions change, so points in 
the ensemble that were being pushed away at one instant 
may be contracted a short time later. If there is sufficient 
volume contraction and change in orientation of the sta- 
ble and unstable subspaces, the MN network can achieve 
asymptotic stability despite linearly instability. In the fol- 
lowing paragraph, we give some mathematical basis of the 
above by considering a simple linear system description of 
variations from the synchronization manifold. 
Consider the n dimensional initial value problem 

i = A{t)z, z{0) - 20, (8) 

where A{t) = X^i X[iT,(i+i)T] (^)^i is a piecewise con- 
stant matrix, i an integer, and T constant. For nar- 
rative simplicity here, assume Ai is a diagonal matrix, 
Ai — diag{Xii, . . . , Xin}. Since diagonal matrices com- 
mute, we may write the time tk = Tk solution to (jS)) 
as 

The fundamental solution matrix is diagonal with entries 

Xj = e"^'' , with Sjk — X]i=o^ KjT, and each j can be asso- 
ciated with a coordinate direction in R". Stability of the 
origin is ensured if Sjk is bounded above for all j and k. If 
Sjk — — oo, then the origin is asymptotically stable. Sup- 
pose the AiS are chosen ergodically from a distribution 
such that for all i, tr{Ai) < e < 0. Moreover, assume that 
the positive and negative eigenvalues are distributed er- 
godically along the diagonal elements of Ai. Then the time 
average (over i) must be the same as the spacial average 
(over j) of the eigenvalues, which implies that Sjk — > — oo. 
Since det($(t2, ti)) = e^o *'-('4(T))<ir ^ ^^^^ ^-^^^ ^^le 

system is volume contracting. 

Time-Average Scale-Pree Network. The main 
thrust of this modeling effort is to show that it is useful 
to consider evolving networks. The underlying time av- 
erage degree distribution remains very fiexible, including 
possibility of the scale-free distribution seen so frequently 
in many applications, The basic MN network gener- 

ates a binomial degree distribution, seen easily as follows. 
The probability that node j is e > close to node i, which 
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Latency Variable friendliness 




FIG. 3: Either exponential latency (a) or exponential neigh- 
borhood size (b) can generate scale-free average distributions. 

is at a position x is, p{x,e) = J!^^^ dij{x), (by assuming 
the network has the ergodic invariant measure n{x)). The 
'long-run' probability that i and j coincide to within e 
is p{e) = J p{x, e)d^i{x), where p = p{e) is simply some 
function of e. Therefore, the time-average degree distribu- 
tion of MN is the binomial Pp(e)(fc) = ^ 

which is asymptotically Poisson for n >> 1, or p << 1. 

A time-averaged scale-free network requires a substan- 
tially heavier tail than the basic MN model. Thus moti- 
vated, and also considering that social connections, once 
formed, have certain persistence or memory, we model that 
some agents "stay in touch," continuing to communicate 
for some period after they are no longer neighbors. We 
formulate the following modification to MN, which we call 
Moving Network with Friends, or MNF: To each agent we 
associate a random "gregarious factor," gi = U{0, 1). As 
with MN, a new link is made between agents i and j when- 
ever ja^i — < e. However, once formed, we introduce 
latency as follows: At each time step T after \xi — Xj \ > e, 
we break the link i <-> j iff a uniform random q — C/(0, 1) 
variable satisfies q > F{gj, gi) — I — yj^gjgj, where there is 
tremendous freedom in choosing F depending upon the ap- 
plication, but we have chosen a specific form as matter of 
example here. The exponential latency creates the power- 
law tail in the degree distribution, as shown in Fig.|3| The 
early rise left of the maximum follows since our model still 
forms connections according to the binomial distribution 
of MN, but now they are broken more slowly. For large 
k, we find empirically that -P(fc) ~ k~°' with a w 2. An 
MNF, since it provides additional connectivity, has more 



robust synchronization properties than an MN network 
with the same neighborhood size, r. 

It easy to formulate other MN-type models which pro- 
duce a scale free structure, and we mention one more which 
we find sufficiently applicable. One can model that some 
nodes are "friendlier" than others by defining the neigh- 
borhood of node i to be of size r^, where need not be 
the same for every node. An power-law distribution of 
would also generate a time-average scale-free network. 

Conclusions and Direction: In many real processes 
in which information propagation in ad hoc networks (such 
as disease spread, where the infective information may sur- 
vive within an agent on the order of just weeks), the recent 
network connections play a crucial role in the dynamic 
behavior of the system. Thus we have been motivated 
to study time-evolving networks, which may more accu- 
rately describe the relevant dynamics. Our MN and MNF 
models provide a first attempt at developing such mod- 
els, basing the network upon diffusing agents communi- 
cating within geographic neighborhoods and with estab- 
lished "friends." The numerical simulations in this paper 
show that global patterns (synchronization) are possible 
in these models, even when the network is spatially dis- 
connected. We are developing a rigorous analysis of the 
moving average Laplacian to support our empirical work, 
which well predicts stability criteria that can be related to 
previous network synchronization results. Under the very 
general assumptions of ergodic network dynamics of the 
agents movements, we have proven the concept of an av- 
erage degree distribution, and we have further shown that 
adding natural latency to network connectionism leads to 
the widely observed phenomenon of scale-free degree dis- 
tribution, but now in a time-averaged sense, which is our 
new concept. We expect these models to widely provide in- 
sight into relevant issues regarding swarming, flocking and 
other physical and technological ad hoc cooperative and 
emergent behavior, particularly if one expects the flock to 
act in some fashion that achieves a goal separate from the 
coordinated movement. 
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by JDS as part of a doctoral dissertation. 
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